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Abstract —We introduce the concept of autoregressive moving 
average (ARMA) filters on a graph and show how they can he 
implemented in a distributed fashion. Our graph filter design 
philosophy is independent of the particular graph, meaning that 
the filter coefficients are derived irrespective of the graph. In 
contrast to finite-impulse response (FIR) graph filters, ARMA 
graph filters are robust against changes in the signal and/or 
graph. In addition, when time-varying signals are considered, 
we prove that the proposed graph filters behave as ARMA filters 
in the graph domain and, depending on the implementation, as 
first or higher ARMA filters in the time domain. 

Index Terms —Signal processing on graphs, graph filters, graph 
Fourier transform, distributed time-varying computations 


I. Introduction 

The emerging field of signal processing on graphs ||T]- 
0 focuses on the extension of classical discrete signal 
processing techniques to the graph setting. Arguably, the 
greatest breakthrough of the field has been the extension of 
the Fourier transform from time signals and images to graph 
signals, i.e., signals defined on the nodes of irregular graphs. 
By providing a graph-specific definition of frequency, the 
graph Fourier transform (GFT) enables us to design filters for 
graphs: analogously to classical filters, graph filters process a 
graph signal by amplifying or attenuating its components at 
specific graph frequencies. Graph filters have been used for 
a number of signal processing tasks, such as denoising Q, 
0, centrality computation g, graph partitioning Q, event¬ 
boundary detection 0, and graph scale-space analysis |T§. 

Distributed implementations of filters on graphs only 
emerged recently as a way of increasing the scalability of 
computation 0 , GT), (ig. Nevertheless, being inspired by 
finite impulse response (FIR) graph filters, these methods are 
sensitive to graph changes. To solve the graph robustness issue, 
distributed infinite impulse response (HR) graph filters have 
been proposed by Shi et al. m- Compared to FIR graph 
filters, HR filters have the potential to achieve better inter¬ 
polation or extrapolation properties around the known graph 
frequencies. Moreover, by being designed for a continuous 
range of frequencies, they can be applied to any graph (even 
when the actual graph spectrum is unknown). 

In a different context, we introduced graph-independent HR 
filter design, or what we will label here as universal HR 
filter design (in fact, prior to (13|) using a potential kernel 
approach 0, IE). In this letter, we will build upon our 
prior work to develop more general autoregressive moving 
average (ARMA) graph filters of any order, using parallel 
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or periodic concatenations of the potential kernel. This leads 
to a more intuitive distributed design than the one proposed 
by Shi et al., which is based on gradient-descent type of 
iterations. Moreover, we show that the proposed ARMA graph 
filters are suitable to handle time-varying signals, an important 
issue that was not considered previously. Specifically, our 
design extends naturally to time-varying signals leading to 
2-dimensional ARMA filters: an ARMA filter in the graph 
domain of arbitrary order and a first order AR (for the periodic 
implementation) or a higher order ARMA (for the parallel 
implementation) filter in the time domain; which opens the 
way to a deeper understanding of graph signal processing, 
in general. We conclude the letter by displaying preliminary 
results suggesting that our ARMA filters not only work 
for continuously time-varying signals but are also robust to 
continuously time-varying graphs. 

II. Graph Filters 

Consider a graph G = {V, E) of N nodes and let a; be a 
signal defined on the graph, whose i-th component represents 
the value of the signal at the i-th nod^ 

Graph Fourier Transform (GFT). The GFT transforms a 
graph signal into the graph frequency domain: the forward and 
inverse GFTs of x are = {x, cf>n) and a;„ = {x, ^„), where 
(,) denotes the inner product. Vectors {<pn}n=i fomi an or¬ 
thonormal basis and are commonly chosen as the eigenvectors 
of a graph Laplacian L, such as the discrete Laplacian or 
Chung’s normalized Laplacian L^. For an extensive review of 
the properties of the GFT, we refer to 0, Q. 

To avoid any restrictions on the generality of our approach, 
in the following we present our results for a general basis 
matrix L. We only require that L is symmetric and 1-local: 
for all i j, Lij = 0 whenever Ui and Uj are not neighbors 
and Lij = Lji otherwise. 

Graph filters. A graph filter F is a linear operator that acts 
upon a graph signal x by amplifying or attenuating its graph 
Fourier coefficients as 

N 

Fx = ^ ^ h{\,fj Xn(pn- (1) 

n—1 

Let X„,i„ and X^ax be the minimum and maximum eigenvalues 
of L over all possible graphs. The graph frequency response 
h : [Xmin, X„uix\ -A C controls how much F amplifies the 
signal component of each graph frequency 

h{Xn) = {Fx, (t)n)/{x, cj)n)- (2) 

*We denote the i-th component of a vector x as Xi stalling at index 1. 
Node 2 of a graph is denoted as Ui. 
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Distributed graph filters. We are interested in how we can 
filter a signal with a graph filter in a distributed way, 
having a user-provided frequency response h*{X). Note that 
this prescribed h*{X) is a continuous function in the graph 
frequency A and describes the desired response for any graph. 
The corresponding filter coefficients are thus independent of 
the graph and universally applicable. 

FIRx filters. It is well known that we can approximate F 
in a distributed way by using a K-\h order polynomial of L. 
Define FIR;<- as the K-\h order approximation given by 

K 

FK = h^lFY,hkL^, 

k=l 

where the coefficients hi are found by minimizing the least- 
squares objective | — ^*(A)pdA. Observe that, 

in contrast to traditional graph filters, the order of the con¬ 
sidered universal graph filters is not necessarily limited to N. 
By increasing K, we can approximate any filter with square 
integrable frequency response arbitrarily well. 

The computation of FIRi^ is easily performed distributedly. 
Since L^x = L each node Ui can compute 

the iFth-term from the values of the {K — l)th-term in its 
neighborhood. The algorithm terminates after K iterations, 
and, in total, each node exchanges 0{K deg Ui) bits and stores 
0{degUi -I- K) bits in its memory. However, FIR^f filters 
exhibit poor performance when the signal or/and graph are 
time-varying and when there exists asynchronicity among the 
node^ In order to overcome these issues and provide a more 
solid foundation for graph signal processing, we study ARMA 
graph filters. 


III. ARMA Graph Filters 


spectral radius: M = I — L. From Sylvester’s matrix 

theorem, matrices M and L have the same eigenvectors and 
the eigenvalues pn of M differ by a translation to those of 

hn {,^max ^n- 

Proposition 1. The frequency response of ARMAi is g{p) = 
s.t. \p\ > ^ the residue r and the pole p 

given by r = —p/ip and p = l/ip, respectively Recursion 01 
converges to it linearly, irrespective of the initial condition yo 
and matrix L. 


Proof. The proof follows from Theorem 1 in |14|, in which 
we replace P with M and 1 — p with -ip. □ 


Recursion Q leads to a very efficient distributed imple¬ 
mentation: at each iteration t, each node Ui updates its value 
yt^i based on its local signal Xi and a weighted combination 
of the values yt-i,j of its neighbors Uj. Since each node 
must exchange its value with each of its neighbors, the 
message/space complexity at each iteration is 6>(degUi) bits. 

Parallel ARMA^ filters. We can attain a larger variety of 
responses by simply adding the output of multiple 1st order 
filters. Denote with the superscript k the terms that correspond 
to the fc-th ARMAi filter (k = 1,2,..., K). 


Corollary 1. The frequency response of a parallel ARMAk is 


K 


rW 

dip) = ^ — 


k=l 


p-p- 


(fc) 


S.t. > 


Xmax Xn 


with and p^^^ = respectively. 

Recursion (|^ converges to it linearly, irrespective of the initial 
condition yo and matrix L. 


A. Distributed computation 

We start by presenting a simple recursion that converges to 
a filter with a 1st order rational frequency response. We then 
propose two generalizations with K-th order response^ Using 
the first, which entails running AT 1st order filters in parallel, 
a node Ui attains fast convergence at the price of exchanging 
and storing 0{K degiti) bits per iteration^ By using periodic 
coefficients, the second algorithm reduces the number of bits 
exchanged and stored to 0{deg Ui), at almost equivalent (or 
even faster) convergence time. 

ARMAi filters. We will obtain our first ARMA graph filter 
as an extension of the potential kernel IB- Consider the 
following 1st order recursion: 

Vt+i = i^Myt + (fx and arbitrary, (3) 


Proof. (Sketch) From Proposition [T] at steady state, we have 


K 


K N 




-(fc) 




Xn^ni 


k — 1 k—1 n—l 

and switching the sum operators the claim follows. □ 


The frequency response of a parallel ARMA if is therefore a 
rational function with numerator and denominator polynomials 
of orders K—1 and K, respectivel}0 At each iteration, node 
Ui exchanges and stores 0{K deg Ui) bits. 

Periodic ARMA/f filters. We can decrease the memory 
requirements of the parallel implementation by letting the filter 
coefficients vary in time. Consider the output of the time- 
varying recursion 


where the coefficients p, ip are (for now) arbitrary complex 
numbers, and M is the translation of L with the minimal 

^This because, first the distributed averaging is paused after K iterations, 
and thus the filter output is not a steady state; second the input signal is only 
considered during the first iteration. To track time-varying signals, the com¬ 
putation should be restarted at each time step, increasing the communication 
and space complexities to 0{K^ degn;) bits and 0(K deg m + K^) bits. 

^Note that similar structures were independently developed in (l3) , although 
based on a different design methodology. 

'^Any values stored are overwritten during the next iteration. 


yt+i = (6»tl + 'ftM)yt P PtX and yo arbitrary, (4) 

every K iterations, where coefficients are periodic 

with period K: Ot = = 'ft-zK,Pt = Pt-zK, with i 

an integer in [0, t/K] and 9t = 1 — Ill/f (f) being the negated 
Shah function. 

^By choosing the coefficients properly, we can generalize the rational 
function to have any degree smaller than K in the numerator. By adding 
an extra input, we can also obtain order K in the numerator. 
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Proposition 2 . The frequency response of a periodic ARMAk 
filter is 

/ ^ Er =0 Y\t7 =K-T^^<^ PK-t-1 

= -- / -——T--> 

1 - (rir^O + 'fprP) 

s.t. the stability constraint \Y\^=o + i’r \ < 1. 

Recursion Q converges to it linearly, irrespective of the initial 
condition j/o and matrix L. 

Proof. Define matrices Ft = djl + iptM and = 

Ft^Ft^-i ■ ■ ■ Ft^ if fi > t 2 and = I otherwise. The 

output at the end of each period can be re-written as a time- 
invariant system 

y(i+i)K = Ay,K + Bx, (5) 

with A = ^K-i.p, B = Y1,t=o Assum¬ 

ing that A is non-singular, both A and B have the same 
eigenvectors <pn as M (and L). As such, when \\max{-A)\ < 1, 
the steady state of Q is 

y = {I- A)-^Bx = g 

To derive the exact response, notice that 

^2 *2 

An(-Z~i) = {6^ + ijjrfJ-n) , 

T — ti T — ti 

which, by the definition of A and B, yields the desired 
frequency response. The linear convergence rate follows from 
the linear convergence of (|^ to y with rate 7 = | Amai(A) |. □ 

By some algebraic manipulation, we can see that the fre¬ 
quency responses of periodic and parallel ARMA^f filters are 
equivalent at steady state. In the periodic version, each node 
Ui stores 0(deg(tti)) bits, as compared to 0{K deguf bits in 
the parallel one. The low-memory requirements of the periodic 
ARMA/f render it suitable for resource constrained devices. 

Remark 1. Since the designed ARMAfc filters are attained for 
any initial condition and matrix L, the filters are also robust to 
slow time-variations in the signal and graph. We will generalize 
this result to arbitrary time-varying signals in Section [7V| 


B. Filter design 

Given a graph frequency response g* : [pmin , Pmax\ C and 
a filter order K, our objective is to find the complex polyno¬ 
mials pb{p) and Pa{p) of order K — 1 and K, respectively, 
that minimize 


Pb{y) 


Paifi) 


- 9 * id) 


dp,= 






dp, 


while ensuring that the chosen coefficients result in a stable 
system (see constraints in Corollary [T] and Proposition |^. 


Remark 2. Whereas g* is a function of p, the desired frequency 
response h* : [X„,m, Amm] —>■ C is often a function of X. We 
attain g* (p) by simply mapping the user-provided response to 
the domain of p: g*{p) = h*{{X„ax - Am,„)/2 - A). 




X 


Fig. 1. The frequency response of ARMAj^' filters designed by Shank’s 
method and the FIR responses of con'esponding order. Here, h* is a step 
function (top) and a window function (bottom). 


-ARMA parallel ——ARMA periodic - IIR direct - HR parallel 



0 10 20 30 40 50 60 70 80 90 100 

iteration 


Fig. 2. Convergence comparison of ARMA filters w.r.t. the IIR filters of HD 
The filtering error is \\yt — y*II 2 /IIJ/*|| 2 , where y* is the desired output. 


Remark 3. Even if we constrain ourselves to pass-band filters 
and we consider only the set of L for which {X„,ax—X,„in)/‘2 = 1, 
it is impossible to design our coefficients based on classical 
design methods developed for UR filters (e.g., Butterworth, 
Chebyshev). The stability constraint of ARMAk is different 
from classical filter design, where the poles of the transfer 
function must lie within (not outside) the unit circle. 

Design method. Similar to Shank’s method | [T5| , we approx¬ 
imate the filter coefficients in two steps: 

1) We determine by finding a K > K order 

polynomial approximation g{p) = Y^^=u9kP^ of 9*{p) using 
polynomial regression, and solving the coefficient-wise system 
of equations Pa{p)9{p) = Ph{p)- 

2) We determine by solving the constrained least- 

squares problem of minimizing \Pb{p)/Pa{p) ~ 9*{p)\'^‘ip, 
w.r.t. pb{p) and s.t. the stability constraints. 

Figure [T] illustrates in solid lines the frequency responses of 
three ARMA^ filters (K — 5,10, 20), designed to approxi¬ 
mate a step function (top) and a window function (bottom). In 
the first step of our design, we computed the FIR filter y as a 
Chebyshev approximation of g* of order K = K -\-l. ARMA 
responses closely approximate the optimal FIR responses for 
the corresponding orders (dashed lines). 

Figure compares the convergence of our recursions w.r.t. 
the IIR design of |[T3j in the same low-pass setting of Figure [T] 
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(top), running in a network of n = 100 node^ We see how 
our periodic implementation (only valid at the end of each 
period) obtains faster convergence. The error of other filters 
increases significantly at the beginning for K = 20, due to the 
filter coefficients, which are very large. 

IV. Time variations 

We now focus on ARMA^^ graph filters and study their 
behavior when the signal is changing in time, thereby showing 
how our design extends naturally to the analysis of time- 
varying signals. We start by ARMAi filters; indicate with 
Xt the graph signal at time t. We can re-write the ARMAi 
recursion as 

yt+i = ^Myt + ipxt. ( 6 ) 

The graph signal Xt can still be decomposed into its graph 
Fourier coefficients, only now they will be time-varying, 
i.e., we will have a;„ *. Under the stability condition ||'0A4’|| < 
1 , for each of these coefficients we can write its respective 
graph frequency and standard frequency transfer function as 

= . (7) 

z — ipy, 

The transfer functions H{z,^) characterize completely the 
behavior of ARMAi graph filters for an arbitrary yet time- 
invariant graph: when z —> 1 , we obtain back the constant x 
result of Proposition while for all the other z we obtain the 
standard frequency response as well as the graph frequency 
one. As one can see, 1st order filters are universal ARMAi in 
the graph domain (they do not depend on the particular choice 
of L) as well as 1st order AR filters in the time domain. This 
result generalizes to parallel and periodic ARMA/j- filters. 

Parallel ARMA/^. Similarly to Corollary [T] we have: 

Proposition 3. Under the same stability conditions of Corol¬ 
lary^ the transfer function H{z,p) from the input Xt to the 
output yt of a parallel ARMAk implementation is 

Proof. The recursion (|^ for the parallel implementation reads 

k = l,...,K ( 8 ) 

while the output is yt = 'Yl,k=i ■ This can be written in a 
compact form as 

wt+i = Awt + Bxt, yt = Cwt, (9) 

(k) 

where Wt is the stacked version of all the yl , while 

A = blkdiag['!/:^^^iW,..., B = ..., , 

and C — 1^ C) I. Under the same stability conditions of 
Corollary the transfer matrix between Xt and yt is 

K 

H{z) = C(zl - A)-^B = 

k^l 

^We do not consider the cascade from of |l3| since every module in the 
cascade requires many iterations, leading to a slower implementation. 



: 1 :: i :: t :: i :: i :: i :: i ; 

0 0.5 1 1.5 2 2.5 3 

Speed (meters per iteration) 

Fig. 3. The effect of node mobility inducing a time-varying signal and graph. 
Each error bar depicts the standard deviation of the filtering error over ten 
runs. The response error is \\g{ft) — ^*(/i)|| 2 /|| 5 '*(/^)|| 2 - A small horizontal 
offset was included to improve visibility. 


where we have used the block diagonal structure of A. By 
applying the Graph Fourier transform, the claim follows. □ 

Proposition characterizes the parallel implementation 
completely: our filters are universal ARMA/^ in the graph 
domain as well as in the time domain. 

Periodic ARMA/^. Time-varying signals in the periodic im¬ 
plementation will be analyzed assuming that we keep the input 
Xt fixed during the whole period K. 


Proposition 4. Let XiK be a sampled version of the input signal 
Xt, sampled at the beginning of each period. Under the same 
stability conditions of Proposition^ the transfer function for 
periodic ARMAk filters from Xix to yiK is 


Hk{z,p) = 


E 


K-l 

t—Q 


ncr=if—T PK—t—1 

^ - (nf=0^ + V'r/i) 


( 10 ) 


Proof. (Sketch) One writes the recursion © substituting x 
with XKt, and proceeds as in the proof of Proposition]^ □ 


As in the parallel case, this proposition describes completely 
the behavior of the periodic implementation. In particular, our 
filters are ARMA/f filters in the graph domain whereas 1st 
order AR filters in the time domain. 


The design of H{z, p) and Hk{z, p) to accommodate both 
ARMAjf requirements and bandwidth for time-varying signals 
is left for future research. 


Time-varying graphs. We conclude the letter with a prelim¬ 
inary result showcasing the robustness of our filter design to 
continuously time-varying signals and graphs. Under the same 
setting of Figure [T] we consider Xt to be the node degree, 
while moving the nodes by a random waypoint model | [T6| 
for a duration of 600 seconds. In this way, by defining the 
graph as a disk graph, the graph and the signal are changing. 
In Figure we depict the response error after 100 iterations 
(i.e., at convergence), in different mobility settings: the speed 
is defined in meters per iteration and the nodes live in a box 
of 1000 X 1000 meters with a communication range of 180 
meters. As we observe, our designs can tolerate better time- 
variations. Future research will focus on characterizing and 
exploiting this property from the design perspective. 
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